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A  recent  paper  by  Box  and  Draper  (198^  discussed  the  detection  of  cubic 
lack  of  fit  in  second  order  composite  design  experiments,  and  its  possible 
removal  by  the  use  of  power  transformations  in  the  predictor  variables. 

The  designs  examined  were  five-level  designs  whose  coded  predictor  variables 
could  assume  levels  {-a,  -1,  0,  1,  a)  for  a  f  1  (and,  typically,  a  >  1). 

When  0*1,  only  three  levels  exist  in  the  design  and  certain  singularities 
occur.  Cubic  interaction  contrasts  exist,  but  it  becomes  impossible  to 
estimate  the  power  transformations,  as  previously  when  a  4  1-  This  note  de¬ 
scribes  how  this  happens 
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CUBIC  LACK  OF  FIT  FOR  THREE-LEVEL 
SECOND  ORDER  RESPONSE  SURFACE  DESIGNS'*' 

N.  R.  Draper 


1 .  INTRODUCTION 


We  refer  the  reader  to  Box  and  Draper  (1982)  for  notation  and  intro¬ 
ductory  material.  The  case  where  a  first  order  model  Is  fitted  Is  unchanged, 
and  we  consider  only  the  second  order  case  In  what  follows. 

I 

2  EXAMPLE,  k  -  2. 

Suppose  we  have  a  two-factor  composite  design  consisting  of  a  replicated 

"cube"  (a  square  for  k  =  2) ,  a  “star"  with  axial  distance  a  «  1,  and  six  center 

points.  Table  1  shows  such  a  design,  with  data  manufactured  exactly  as  In  Box 

and  Draper  (1982,  Section  3  and  Appendix  A).  In  fact,  this  example  Is  an 

adaption  of  the  previous  example  In  which  a  »  2,  and  only  the  four  star  points 

have  altered  response  values.  Two  blocks  are  defined,  as  before,  but  the 

2  2 

blocks  column  Is  now  not  orthogonal  to  the  x^  and  x^  colunns.  The  fitted 
least  squares  equation  Is 

y  ■  30.11  -  5.14x^  -  S.IAXg  -  2.22x^  +  0.28x2  -  3.41x^X2 

+  0.35  +  0.21  +  0.21  +  0.44  +  0.44  +  0.24 

where  the  second  order  coefficients  and  constant  term  have  been  estimated 

with  blocks  In  the  model,  but  the  term  -0.09  (blocks),  with  coefficient  s.e. 

0.24,  has  been  omitted,  and  where  +  limits  beneath  each  estimated  coefficients 
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2 

indicate  estimated  standard  errors,  using  the  pure  error  estimate  s^  =  0.457 
2 

to  estimate  a  .  An  associated  analysis  of  variance  table  is  shown  as  Table  2. 

3  2  3  2 

When  a  4  i  >  the  four  third  order  terms  pair  up  as  (x-j  (x2,XiX2) 

and,  when  these  pairs  are  orthogonal i zed  to  X  vectors  of  lower  order, 
yield  two  vectors  (per  pair)  which  are  multiples  of  one  another.  We  thus 
obtain  two  "third  order  vectors"  previously  called  x^^^  and  X222  which  pro¬ 
vide  cubic  orthogonal  contrasts  in  the  x-j  and  X2  directions. 

When  a  =  1,  however,  x^  =  x^  throughout.  We  are  thus  left  only  with  the 
2  2 

cubic  vectors  [X1X2]  and  [X1X2].  These  are  orthogonal i zed  against  all  X 
vectors  of  lower  order  to  give  vectors  [x^22^  shown  (without  square 

brackets  and  amplified  by  a  convenient  factor  of  -5)  in  Table  1.  This  is  why 
the  lack  of  fit  in  Table  2  is  attributed  to  b^22  ^112* 

b222  previously  when  a  4  !• 

We  see  from  Table  2  that  the  lack  of  fit  tests  are  all  nonsignificant, 
in  spite  of  the  fact  that  the  surface  is  the  same  non-quadratic  one  as  we 
had  before,  for  which  cubic  lack  of  fit  was  apparent.  The  pulling  in  of 
the  star  points  from  levels  +2  to  levels  +1  has  rendered  pure  cubic  non- 
quadraticity  undetectable,  in  fact.  Why  this  is  so  is  apparent  from  the 
geometry.  The  geometrical  meaning  of  the  cubic  contrast  illustrated  in 
Figure  1  of  the  previous  paper  no  longer  applies.  Whereas  before  we  were 
examining  the  difference  between  the  slopes  of  two  chords  whose  slopes 
would  be  equal  if  the  model  were  actually  quadratic  in  the  x^  dimension, 
we  are  now  contrasting  two  unequally  weighted  estimates  of  the  slope  of  the 
same  chord.  Thus  while  cubic  interaction  coefficients  can  still  cause 
distortion,  as  is  clear  from  the  expected  value  in  Eq.  (3.3),  setting  a  =  1 
has  lost  us  our  ability  to  detect  the  presence  of  6^^^. 
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Table  2.  Analysis  of  variance  associated  with  the  second  order 
model  and  Its  checks,  for  the  data  of  Table  1. 


} 


Source 

df 

SS 

NS 

F 

Mean 

1 

15,167.014 

- 

- 

Blocks 

1 

5.667 

5.667 

10.83 

First  order 

2 

926.792 

463.396 

885.88 

Second  order  extra 

3 

104.882 

34.961 

66.84 

Lack  rb^22 

*1 

2.070  1 

'  2.070 

r  4.53 

of  <  b^^2  ^ 

1 

2.097 

0.000  0.699  ^ 

0.000 

1.53]  0.00 

fit  L  CC 

l1 

0.027  1 

.  0.027 

i  0.06 

Pure  error 

8 

3.657 

0.457 

i 


Total 


18  16.210.110 


Notes: 


(d) 


Roundoff  error  of  0.001  occurs  In  the  addition. 

First  order  Is  orthogonal  to  everything  else. 

Mean,  blocks,  and  pure  quadratic  are  not  mutually  orthogonal. 

Thus  the  breakup  (In  more  detail)  Is  mean,  blocks,  and  second 
order  given  mean  and  blocks.  "Blocks"  Is  significant  only  If 
taken  out  In  the  order  Indicated. 

Lack  of  fit  tests  provide  non-significant  results  at  the 
a  ■  0.05  level.  Tests  for  regression  thus  use  s‘  ■  (2.097+3.657) 
/II  -  0.523  as  denominator. 
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3.  GENERAL  FORMULAS 


In  general,  a  three-level  composite  design  contains 

l(  lc~D 

(a)  A  "cube”,  consisting  of  a  2  factorial,  or  a  2  ^  fractional  factorial, 
made  up  of  points  of  the  type  (+1,+1,...,+1),  of  resolution  R  >  5  (Box  and 

k-n 

Hunter,  1961)  replicated  f(>l)  times.  There  are  thus  n  =  f2  such  points 
(where  p  may  be  zero). 

(b)  A  "star",  that  Is,  2k  points  (+1 ,0,0,. . . ,0) ,  (0,+l  ,0,. . . ,0) ,. . . , 
(0,0,0,...,+!)  on  the  predictor  variable  axes,  replicated  r  times,  so  that 
there  are  n^  =  2kr  points  In  all. 

(c)  Center  points  (0,0, ...,0),  n  In  number,  of  which  n  are  In  cube 

blocks  and  n..  In  star  blocks, 
so 

It  can  be  shown  that,  for  any  such  design,  k  sets  of  columns  can  be 

Isolated  with  the  1th  set  containing  the  k  columns  x^Xj,  1  f  j  -  1,2 . k. 

This  1th  set  Is  associated  with  a  single  vector  x^^j  which  Is  orthogonal  to 
the  (k+l)(k+2)/2  columns  required  for  fitting  the  second  degree  equation  and 
Is  also  orthogonal  to  the  (k-1)  similarly  constructed  vectors  t  1. 

The  x^  vectors  do  not  feature  In  these  sets  of  columns  as  they  do  when  a  ^  1, 

3 

because  x^  =  x^  throughout,  now. 

The  elements  of  these  vectors  are  such  that: 
for  the  cube  points,  x^jj  ■  ♦x^,  with  ♦  »  2r/(ng+2r), 
for  the  star  points,  X|jj  »  yx^,  with  y  *  -ng/(np+2r), 
for  the  center  points  x^jj  =  0  *  x^. 
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Thus,  the  k  estimates  of  third  order  lack  of  fit,  c^-j,  0^2 . (^3I( 


*^31 


rJar»-a) 

2  "  2 


with  standard  deviation 


Also 


E(c3i) 


(3.1) 


(3.2) 


(3.3) 


and  the  contribution  to  the  lack  of  fit  sum  of  squares  Is 

SS(c3i)  ■  •  <3.4) 

The  result  of  Eq.  (3.3)  Implies  that  effects  due  to  are  no  longer  de¬ 
tectable  via  Cj^  when  a  ■  1.  (Compare  Eq.  (3.3)  with  Eq.  (3.7)  of  the  earlier 
paper.) 
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4.  INABILITY  TO  ESTIMATE  TRANSFORMATION  PARAMETERS 

When  a  =  1,  it  Is  Impossible  to  carry  through  the  procedure  to  estimate 
for  the  transformation  of  the  predictor  variables.  Consider  Eqs. 
(3.12),  (3.13),  and  (3.14)  of  the  previous  paper.  A  composite  design  in 
general  (afl)  does  not  enable  us  to  estimate  all  cubic  terms,  and  when  a  =  1, 
we  specifically  cannot  estimate  the  3^^^.  Thus  the  previous  Eq.  (3.12)  must 
be  replaced  by 


^211^2^1  * 


*  ®kmm^k^m 


(4.1) 


where  j,t,..,,m  can  take  any  specific  values  except  (respectively),  l,2,...,k 
Eq.  (4.1)  represents  the  third  order  terms  whose  parameters  can  be  estimated 
using  a  composite  design  with  a  =  1.  If  the  actual  response  could  be  repre¬ 
sented  by  a  full  third  order  model,  the  estimates  b^  and  b^^.j  obtained  from 
the  composite  design  with  a  =  1  would  have  expectations 


E(b^)  » 


(4.2) 

(4.3) 


these  equations  replacing  (3.13)  and  (3.14)  of  the  original  paper.  Now,  if 

a  second  order  representation  in  transformed  predictor  variables  were 

indeed  satisfactory,  all  third  derivatives  of  the  third  order  model  with 
^i 

respect  to  the  would  be  zero.  Requiring  this  leads  to  the  conditions 
(where  the  6^  are  known  constants) 
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an  M  J  •  “  1 .2 . k; 


(4.4) 


i  ^  j  “  1t2>...ikt 


^111  ^  ^  ( 1  ) (1  “2X^ )ri^  *  0»  1  ®  l92»*««9ki 


(4.5) 


(4.6) 


Eq.  (4.4)  provides  the  (otherwise  obvious)  conclusion  that  the  possibility 
of  second  order  representation  In  the  transformed  variables  Is  contra-indicated 
If  one  or  more  Interaction  estimates  b^jj^  are  non-zero. 

We  would  now  like  to  use  b^  and  b^jj  as  estimates  of  their  expectations 
In  (4.2)  and  (4.3)  and  substitute  these  Into  (4.5)  and  (4.6)  to  give  equations 
for  the  X^.  (We  would  also  need  to  substitute  estimates  for  and  which 
Involve  b^^  and  b^j  but  these  are  not  Involved  In  the  argument  which  follows.) 
It  soon  becomes  apparent  that  the  combination  of  and  In  Eq.  (4.2) 
and  the  lack  of  either  In  Eq.  (4.3)  makes  It  Impossible  to  manipulate  Eqs. 

^4.5)  and  (4.6)  Into  a  suitable  set  of  equations  for  the  X^,  as  was  achieved 
In  the  a  4  I  case. 

The  moral  Is  simply  that  the  choice  of  only  three  levels  of  the  predictor 
variables  Is  Inadequate  to  the  task  at  hand.  When  a  »  1,  pure  cubic  lack  of 
fit  Is  not  detectable  and  the  transformation  parameters  X^  cannot  be  estimated. 

(If  an  attempt  Is  made  via  nonlinear  estimation  methods  to  fit  a  second 
^1 

order  model  In  to  the  data,  a  highly  Ill-conditioned  sum  of  squares  sur¬ 
face  results  with  consequent  problems  of  convergence.  The  correlation  matrix 
for  the  estimates  has  several  entries  close  to  1,  Indicating  severe  overpara¬ 
meterization,  as  would  be  expected.) 
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SUMMARY 


An  earlier  paper  by  Box  and  Draper  (1982)  discussed  lack  of  fit  for 
certain  first  and  second  order  designs  and  their  ability  to  detect  certain 
kinds  of  lack  of  fit  of  degree  one  higher  than  has  been  fitted.  Composite 
designs  with  five  levels  were  explored  for  the  second  order  situation.  In 
this  note,  we  discuss  three-level  composite  designs  and  show  that,  while 
they  allow  the  examination  of  certain  types  of  third  order  curvature,  they 
do  not  permit  estimation  of  power  transformations  in  the  predictor  variables 
to  achieve  second  order  representation  in  the  transformed  variables.  The 
moral  is  that,  for  this  sort  of  transformation  estimation,  five  levels 
are  essential. 

ACKNOWLEDGEMENTS 

This  work  was  partially  sponsored  by  the  United  States  Army  under 
Contracts  Nos.  DAAG29-80-C-0041  and  DAAG29-80-C-0113.  I  am  grateful  to 
Michael  Wincek  for  a  computer  calculation. 

REFERENCES 


Box,  G.  E.  P.  and  Draper,  N.  R.  (1982).  Measures  of  lack  of  fit  for 
response  surface  designs  and  predictor  variable  transformations. 
Technometrics,  23,  000-000. 

Box,  G.  E.  P.  and  Hunter,  0.  S.  (1961).  The  2*^~^  fractional  factorial 
designs.  Part  I.  Technometrics,  3,  311-351;  Part  II,  449-458. 


security  classification  of  this  PAC£  Dmt»  Fnt^rmd) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  REPORT  NUMBER  ^  -v  *•  <»OVT  ACCESSION  NO. 

2323 

3.  RECIPIENT'S  CAT  ALOG  NUMBER 

/ 

■y 

4.  title  fand  SiFbcUlc) 

CUBIC  LACK  OF  FIT  FOR  THREE-LEVEL  SECOND  ORDER 
RESPONSE  SURFACE  DESIGNS 

5.  TYPE  OF  REPORT  A  PERIOD  COVERED 

Summary  Report  -  no  specific 
reporting  period 

6.  PERFORMING  ORC.  REPORT  NUMBER 

7.  AUTHORr*; 

N.  R.  Draper 

a.  contract  OR  grant  NUMBERf*; 

DAAG29-80-C-00  41 
DAAG29-80-C-0113 

9.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 

Mathematics  Research  Center,  University  of 

610  Walnut  Street  Wisconsin 

Madison.  Wisconsin  53706 

10.  PROGRAM  element.  PROJECT.  TASK 
AREA  &  WORK  UNIT  NUMBERS 

4-Statistics  and  Probability 

U.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

U.  S.  Army  Research  Office 

P.O.  Box  12211 

Research  Triangle  Park,  North  Carolina  27709 

IZ.  REPORT  DATE 

January  1982 

•  3.  NUMBER  OF  PAGES 

9 

u.  MONITORING  AGENCY  NAME  A  AOORESSfIt  tUIUnnt  from  Conuolllng  Ollica) 

IS.  security  class,  (of  thlo  roporf) 

UNCLASSinZD 

tSa.  DECLASSIFICATION/ DOWN  GRADING 

schedule 

l«.  DISTRIBUTION  STATEMENT  (of  thlo  Ropoet) 

Approved  for  public  release;  distribution  unlimited. 

tT.  DISTRIBUTION  STATEMENT  (of  Via  abtiraci  anlarad  In  Block  30,  If  dl/laranl  from  Roporf) 

IS.  SUPPLEMENTARY  NOTES 

t9.  KEY  WORDS  (Conllnua  on  rororao  ofclo  it  noeoaaonp  and  IdoAtlfy  by  bfocit  numbor> 

Lack  of  fit.  Second  order  designs.  Transformations  on  predictors 

20.  ABSTRACT  {Cont/nue  on  r«r*r««  aid*  n«e««««fY  and  identity  by  blocA  nuaibaO 

A  recent  paper  by  Box  and  Draper  (1982)  discussed  the  detection  of  cubic  lack  of 
fit  In  second  order  composite  design  experiments,  and  Its  possible  removal  by  the 
use  of  power  transformations  In  the  predictor  variables.  The  designs  examined 
were  five-level  designs  whose  coded  predictor  variables  could  assume  levels  (-a, 
-1,0,1, a)  for  a^1  (and,  typically,  a>1).  When  a=1 ,  only  three  levels  exist  in 
the  design  and  certain  singularities  occur.  Cubic  Interaction  contrasts  exist, 
but  It  becomes  Impossible  to  estimate- the  power  transformations,  as  previously 
when  o/l.  This  note  described  how  this  haooens. 

IJAN*?!  1473  edition  OP  I  NOV  6S  IS  OBSOLETE 


UNCLASSIFIED 


security  classification  of  This  pace  (Wh»n  Data  Enttrmd) 


mm 


